Relative Information Loss - An Introduction
نویسندگان
چکیده
We introduce a relative variant of information loss to characterize the behavior of deterministic input-output systems. We show that the relative loss is closely related to Rényi’s information dimension. We provide an upper bound for continuous input random variables and an exact result for a class of functions (comprising quantizers) with infinite absolute information loss. A connection between relative information loss and reconstruction error is investigated.
منابع مشابه
Estimating a Bounded Normal Mean Relative to Squared Error Loss Function
Let be a random sample from a normal distribution with unknown mean and known variance The usual estimator of the mean, i.e., sample mean is the maximum likelihood estimator which under squared error loss function is minimax and admissible estimator. In many practical situations, is known in advance to lie in an interval, say for some In this case, the maximum likelihood estimator...
متن کاملRELATIVE INFORMATION FUNCTIONAL OF RELATIVE DYNAMICAL SYSTEMS
In this paper by use of mathematical modeling of an observer [14,15] the notion of relative information functional for relative dynamical systemson compact metric spaces is presented. We extract the information function ofan ergodic dynamical system (X,T) from the relative information of T fromthe view point of observer χX, where X denotes the base space of the system.We also generalize the in...
متن کاملClassic and Bayes Shrinkage Estimation in Rayleigh Distribution Using a Point Guess Based on Censored Data
Introduction In classical methods of statistics, the parameter of interest is estimated based on a random sample using natural estimators such as maximum likelihood or unbiased estimators (sample information). In practice, the researcher has a prior information about the parameter in the form of a point guess value. Information in the guess value is called as nonsample information. Thomp...
متن کاملComparing Relative and Additive Contents of Return with Cash Recovery Rate
One of the goals of financial reporting is to provide the useful information in order to facilitate the decision making. Accounting information system is of high importance for the users to make specific decisions. The information should be analyzed to present the valuable information to the investors so that in this paper, the relative content and return additive with cash recovery have been a...
متن کاملE-Bayesian Approach in A Shrinkage Estimation of Parameter of Inverse Rayleigh Distribution under General Entropy Loss Function
Whenever approximate and initial information about the unknown parameter of a distribution is available, the shrinkage estimation method can be used to estimate it. In this paper, first the $ E $-Bayesian estimation of the parameter of inverse Rayleigh distribution under the general entropy loss function is obtained. Then, the shrinkage estimate of the inverse Rayleigh distribution parameter i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1203.6791 شماره
صفحات -
تاریخ انتشار 2012